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(57) ABSTRACT 

Stroke information &om pen-down to pen-up being one unit 
is grouped automatically so that editing thereafter can be 
performed efficiently. Grouping of stroke information is 
determined in accordance with a predetemaincd rule of 
grouping each time stroke information is input or with 
timing indicated by a user. Strokes input within a predeter- 
mined time interval and stroke information input at a posi- 
tion within a predetermined distance interval are assumed to 
be the same group, and in the editing thereafter, a collective 
pointing and processing on a plurality of grouped strokes 
becomes possible. 

24 Clahns, 6 Drawing Sheets 
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FIG. 6 
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EVIAGE PROCESSING METHOD AND It is another object of the present invention to provide an 

APPARATUS image processing method and apparatus capable of auto- 
matically grouping data according to the intention of the 
operator. 

BACKGROUND OF THE INVENTION ^ u , u- * ^- * 

5 It IS yet another object of the present mvention to provide 

1. Field of the Invention an image processing method and apparatus capable of 
The present invention relates to an image processing instructing the execution of a clustering process using a 

method and apparatus for processing handwritten image cltistering rule according to the intention of the operator, 

information written by an operator. n is a further object of the present invention to provide an 

In particular, the present invention relates to an image image processing method and apparatus capable of perform- 

processing method and apparatus for handling stroke data ing editing on strokes which are grouped during input after 

formed of a phirality of coordinate informatioa each stroke is input. 

2. Description of the Related Art It is still a further object of the present invention to 
Generally speaking, as dedicated drawing apparatuses or provide an image processing method and apparatus capable 

information processing apparatuses which read and execute of performing a grouping release process on a phirality of 

a drawing-type application, handwriting information input data which are grouped during input according to the 

apparatuses arc used which input handwriting information intention of the operator. 

and edit it, for example, input traces drawn by an operator It is still a further object of the present invention to 

as strokes by using a handwriting input member, such as a 20 provide an image processing method and apparatus capable 

pen or a mouse, and edit the input strokes. of knowing the state of the grouping of input data. 

Such a handwriting information input apparatus is set in it is still a further object of the present invention to 

such a way that a trace drawn continuously is input as one provide an image processing method and apparatus which 

stroke, and this one stroke is handled as a minimum unit. hold at least one of a chistering level, a stroke input time. 

Since the apparatus is set so that one stroke is handled as a 25 stroke coordinate infoimatioD, positional information, and 

minimum unit as described above, when the same editing is display attributes as clustering information, 

performed on a phirality of input strokes, a method of u is stiU a further object of the present invention to 

groupmg a plurahty of input strokes into one data is often ^ processing method and apparatus which 

used so that a plurality of strokes are edited coUecbvely by ^^q^^^ positions which are defined by a circumscribed tect- 

takmg mto consideration editing efficiency. As a method of 30 angle which surrounds a single stroke or clustered strokes as 

grouping a plurality of mput strokes mto one data, there is positional information. 

a method in which each object stroke is selected and . , ...... . . ... 

indicated individually from among the strokes input by the " .If ^ ^""^^^ "^^^'^ °^ 'u 

operator, and a plurahty of strokes which are indicated so as "°»ee prc^ng method and apparatus which 

to be grouped is handled as one data. TTiere is another 35 ««^.»Jle»«°°eof» difference in input tune between strokes, 

method in which a phirality of input strokes are grouped by »^.^Setenc^m posUion between strokes, or a differeiice m 

using a grouping command. In this method, an areVcon- ^'^^^^V. attributes between strokes as a clustenng rule for 

taining strokes which are grouped by the operator is determmmg whether or not a plurality of strokes should be 

indicated, and each stroke of this indicated area is handled grouped. 

as one data 40 ^ ^ further object of the present invention to 

However! in practice, often a plurahty of strokes are input P^^^^ ^ ^^^^ proce^ing method and apparatus capable 

in time sequence, and the strokes are interrelated. For °f clustering mput strokes more appropriately because a 

example, when characters are input by handwritingby using P^^^^^^ of clustermg mles are heW and the u^ut strokes are 

a pen or the like, often each stroke which forms the character ^""^^ ^ adaptively selected clustering rule, 

is input in a time sequence, and each stroke which forms this 45 The above and further objects, aspects and novel features 

character is handled as one data. Conversely, it is rare that the invention will become more apparent from the fol- 

eacb stroke which forms the character is edited individually. lowing detailed description when read in oonneclion with 

As described above, in the case where each stroke which accompanying drawing?, 
forms a handwritten charaaer is handled as one data, in the 

former method used in the above-described apparatus, each 50 

object stroke must be selected and indicated from among the piG. 1 is a block diagram illustrating the construction of 

input strokes* and this indication operation requires a lot of a first embodiment of a handwriting information input 

time and effort. apparatus according to the present invention; 

In the latter method, although grouping is possible in picS. 2A and 2B show the format of stroke information 

character units by using a grouping command, it is necessary ^^^^ ^ ^^^^ ^^^^^ ^ ^ handwriting informa- 

to indkate an area containing strokes which form a character (jon jjjp^t apparatus of FIG. 1; 

and further, ^en a plurahty of characters are input close to rnr^ ^ u i ru- i i * j * i 

- . . *^ FIG. 3 shows an example of hicrarducal clustered stroke 

each other, a very fine mdication operation becomes neces- j * j- i j j- i r *t„ u j 

r • . 1 J- J- L ^ • . data displayed on the display means of the handwriting 

sary for appropriately dividing the seohon between the mput i^^^^^^ ^ of FIG. 1; 

characters. Therefore, grouping mto character umts cannot °" ^„ ^ . , ., , ^ ^ 

be performed efficienUy. FIG. 4 is a flowchart illustraUng the procedure of a first 

clustering process in the handwriting information input 

SUMMARY OF THE INVENTION apparattis of FIG. 1; 

It is an object of the present invention to provide an image FIG. 5 shows the formal of stroke information stored in 
processing method and apparatus capable of efficiently 65 stroke storage means of a second embodiment of a hand- 
grouping a phirahty of input image data without spending writing information input apparatus according to the present 
time and effort on an operation. invention; and 
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FIG. 6 is a block diagram of the handwriting information may be input via the communication interface 67, and the 
input apparatus. processed results may be output via the communication 

interface 67. 



DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 



The print means 68 prints mid-processing and processed 

5 results, and is realized by an LBP or an ink jet printer. A bus 

The preferred embodiments of the present invention will 69 interconnects each means and allows data transmission, 

be described below with reference to the accompanying The fonctional structure of FIG. 1 will now be described, 

drawings. -j^e handwriting information input apparatus comprises a 

First Embodiment lo ^^^'^ "^P"' means 1 provided with a digitizer on the input 

surface. The stroke input means 1 inputs traces drawn on the 

FIG. 1 is a block diagram illustrating the functional input surface by the operator using a pen as stroke data, and 

construction of a handwriting information input apparatus further after the stroke data is input, it inputs information 

according to the present invention, which is realized by the about the pen operation progression and operation residts. 

apparatus shown in the block diagram of FIG. 6. This input stroke data includes coordinate sequence data that*^ 

The constmction shown in FIG. 6 will be described first. is generated in unit time from when the pen contacts the 

A CPU 61 performs all the processes concerned with the i°put surface until the pen is moved away from the input 

present invention in accordance with control programs surface. The stroke data represented by the coordinate 

stored in a ROM 62. a RAM 63, or a CD-ROM 64. A sequence data obtained during this period is handled as one 

clustering information acquisition means 3 (FIG. 1), a 30 stroke. Information about the pen operation 

clustering means 4 (FIG. 1), a clustering command execu- progression and operation results includes the stroke input 

tion means 6 (FIG. 1), and a command execution means 8 time indicating the stroke input start time and end time, and 

(FIG. 1) are controlled by the CPU 61. The ROM 62 has display attributes indicating the pen thickness, and the like, 

stored therein control programs and parameters used for The stroke data input from the stroke input means 1 is 

various processing, by which the CPU 61 performs pro- 25 related with information about the pen operation progression 

cesses concerned with the present invention such as the and operation results and stored in the stroke storage means 

proc3ess shown in the flowchart (FIG. 4), which will be 2 as stroke information. Further, as will be described later, 

described later. The RAM 63 also stores control programs clustered stroke data such that stroke data belonging to the 

and parameters concerned with the present invention, and is same group is grouped together is stored as stroke informa- 

provided with a working area for storing data that are tion in the stroke storage means 2. The stroke information of 

generated in the middle of processing. Buffers BufA and the clustered stroke data and the stroke information of the 

BufB, to be described later, are provided within the RAM stroke data are described in different formats so that they 

63, and stroke data and clustering data are also stored in the may be identified. These formats will be described later with 

RAM 63. A stroke storage means 2, in FIG. 1, is realized by reference to FIG. 2. 

the RAM 63, and a clustering mle 5 is previously stored in 35 Each time a new stroke is input from the stroke input 

the ROM 62. The CD-ROM 64, which can be removed from means 1, or each time the execution of a clustering process 

the main unit of this apparatus, is a storage medium in which is instructed from the clustering command execution means 

control programs for processes concerned with the present 6, a clustering process is performed by the clustering means 

invention, which are performed by the CPU 61, and param- 4. Specifically, the clustering means 4 performs a first 

eters that are required for processes are prestored. The 4^ clustering process each time a new stroke is input from the 

control programs and data stored in the CD-ROM 64 may be stroke iiq)ut means 1. In this fiist clustering process, initially, 

used after they are stored temporarily in the RAM 63. the possibility of clustering between the new input stroke 

Further, in addition to CD-ROMs, the storage media may be data and the stroke information (stroke data or clustered 

floppy disks, magneto-optic disks, IC cards, and the like, as stroke data) prestored in the stroke storage means 2 is 

long as they can be removed from the main unit of this 45 determined in accordance with the clustering information 

apparatus. An input means 65 includes a pointing device and and a clustering rule 5. When it is determined that clustering 

a tablet capable of pointing or selecting a desired position on of the newly input stroke data with the previously input 

the display means 66 and a keyboard capable of inputting stroke information is possible, the stroke information which 

characters, symbols, frinctions, modes, and so on. The input is determined to be capable of being clustered is read from 

means 65 allows inputting of strokes, and a pointing opera- jq the stroke storage means 2. This read stroke information is 

tion of icons, for example, an indication operation of a grouped with the new input stroke data and converted into 

clustering execute icon or an indication operation of a clustered stroke information and stored in the stroke storage 

cluster di^lay icon, which will be described later. The means 2. That is, the read stroke information is rewritten into 

stroke input means 1 in FIG. 1 is realized by the input means the stored stroke information afUa- being converted. 

55 When the execution of clustering is instructed from the 

The display means 66, formed of a CRT or an IXD, clustering command execution means 6, a second clustering 

displays characters, images, icons, and the like. A display process is performed. In this second clustering process, 

screen, such as that shown in FIG. 3, is generated on this initially, posability of clustering between the new input 

display means 66. The display means 7 in FIG. 1 is realized stroke data and the stroke information (stroke data or 

by the display means 66. 50 chi^ered stroke data) prestored in the stroke storage means 

A conomtmication interface 67 controls the communica- 2 is determined in accordance with the clustering infonna- 

tion process for exchange of data with other terminals via a tion and the clustering rule 5. When it is determined that 

public switched network, a LAN or the like. The control clustering of the newly input stroke with the previously 

programs of processes concerned with the present invention, input stroke information is possible, a plurality of stroke 

which are stored in the RAM 63, may be those read from the 65 information, which is determined as being clustered, is read 

memory of other terminals via the communication interface from the stroke storage means 2. This read stroke infonna- 

67. Further, stroke data and process instruction oonmiands tion is grouped with the new input stroke data and converted 
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into single clustered stroke information, and stored in the operation is performed using a clustering execution icon 
stroke storage means 2. That is, the read stored stroke displayed on the screen of the display means 7, the duster- 
information is rewritten into the stroke information after ing command execution means 6 generates a command for 
being converted. instructing the clustering means 4 to execute the second 
The clustering information used in the above-described 5 clustering process so that the second clustering process 
two clustering processes is dau required for clustering, and described earlier is performed. 

the data are selectively retrieved from ttesttokeinfo^ ^ ^^^^ ^ ^ 

stored m the stroke storage means 2 by the clustering ^^^^ ^ ^^^^^ 

mformadonacquisiuonmear^a. Inthisembodmien^^ ^'^J^ (chistering state) by the clustering means 4. Hie 

stroke mformation, the stroke mput start time (FT), the ,n j- 1 t j- 1 »u . 1 * c «u 

, , . . , . , . ^ • . J- . display means 7 displays the strokes input from the ^roke 

stroke mput end time (ET), the stroke start pomt coordinate • ' 1 l • r*i. * 1 ■ r *■ * j 

/T-r.\ .L .I J • . J- . mn\ J 1 input means 1 on the basis of the stroke mformation stored 

m, the stroke end pomt coordinate (m>). and posiUona^ j^''^^ ^ ^ and displays the chistcr state 

mformation are prepared, and Stored m a format such as that ^ r .u i * j- 1 

• r^j^J: >r* J '^T. /J- , X. . , V aocordmg to the mstruction operation or the cluster display 

shown m FIGS. 2A and 2B (discussed further below). „ *u j- 1 t i • 

n . J - r *- - ^ J c *u . 1 • f icon. Further, the display means 7 displays various icons. 

Required mformation IS extracted from the stroke inmrma- ,« . , ^ j -l j 1 . • - J 
. ^ , - , . t ..15 including the above-described clustering execution icon and 

tion according to the type of clustenng rule. This positional *u u * j* 1 • t jj**- * *L 1 » • 

, - . ? .. •• J J i_ L . the cluster display icon. In addition to the clustenng execu- 

mformation indicates the position defined by the center . „«j .u^ .u^^^ ^ 

i- • -L , 11 i tion icon and the cluster display icon, these various icons 

coordinate of a arcumscnbed rectangle that surrounds a • 1 j * j * .u j-*- r .u . 1 

, , . J* J i_ . 1 mclude icons used in the editmg operation of the stroke 

single stroke mdicatcd by the stroke information. information stored in the stroke storage means 2. Examples 

nie clustenng rule 5 is a nde for detetnumng whether or ^ -^^ .^^^^„^ "Delete", "Grouping", and 

not a plurality of stroke mfonnauon belong to the same ..Qrouping Release". Examples of screen dispbys by this 

group. SpeaficaUy. tha is a rule for determimng whether or j 7 ^, described later, 

not a plurahty of stroke mformation belong to the same „„ - . ... , , ^ . . 

group according to the difference in input time between ^hen an editing instrucUon is issued to each of the icons 

strokes or the difference in position between strokes. In this "Move "r>ele^e » "Groupmg' , and "Groupmg Rel^ ,as 

embodiment, in the first clustering rule 5 used in the first ^ "^^^^ °^ "JP^^ means 65 by the 

clustering process, which is performed each time a new ^P^"^^^ unction is mput to the command execution 

stroke is input from the stroke input means 1, when the « ^^^^^'y an editing process on the stroke informa- 

diffen^nce in input time between strokes (between the new ^^^^ ^^^'^^"^ performed on the 

input stroke data and the stroke information stored in the 30 ^^^.^^ 'f^Tl^^T T^^^^-" T^' <^di!^g <=ontcnts 

stroke storage means 2) is equal to or less than a predcter- ^^^^ ' Groupmg" and Grouping 

mined value (e.g.. 0.5 sec), or when the difference (distance) ^^j^f^ ^ the contents performed normally 

between the stroke start point or end point of one stroke and ^h^^for^, a description thereof has been omitted, 

the stroke start point or end point of the other stroke is equal Next, the format of the stroke mformation stored m the 

to or less than a predetermined value (e.g., 2 mm), it is 35 stroke storage means 2 will be described with reference to 

defined that each stroke belongs to the same group. In F^^S. 2A and 2B. HGS. 2A and 2B show the format of 

comparison with this, in the second clustering rule 5 used in stroke information stored m the stroke storage means of the 

the second clustering process, which is performed when the handwriting information input apparatus of HG. 1. 

execution of a clustering process is instructed from the As described above, the stroke information of stroke data 

clustering command execution means 6, when the difference 49 the stroke information of clustered stroke data are 

(distance) in positional information between the strokes described in different formats so that they can be identified, 

(between the stroke information stored in the stroke storage The stroke information of stroke data is data for one 

means 2), namely, the difference between the circumscribed stroke from pen-down to the next pen-up and is described by 

rectangles of each stroke, is equal to or less than a prede- a sequence of data LVq, Ln, FT, ET, FP, EP, MJ*, M„P, P^, 

termined value (e.g., 3 mm), it is defined that each stroke 45 P^, . . . , and as shown in FIG. 2A. LVq indicates the 

belongs to the same group. The predetermined values clustering level, with data 'tT being assigned to LVq indi- 

defined by this clustering rule are held within the rule in eating that clustering has not been performed. Ln indicates 

advance; however, they may be changed according to, for the data length of this stroke information, and in practice, the 

example, an instruction (direct instmction by a numerical number of words (1 word is equal to 16 bits) of the entire 

value or level instruction) by the user. The reference of 50 stroke data is written therein. FT indicates the stroke data 

clustering of strokes, which arc input afrer the predetermined input start time. ET indicates the stroke data input end time, 

value is changed, may be changed in accordance with the FP indicates the stroke data start-point coordinate. EP indi- 

changing of the predetermined value, or clustering (the same cates the stroke data end-point coordinate. indicates the 

process as the second chistering process) in accordance with maximum coordinates (X, Y) of the stroke data. M„P indi- 

a new predetermined value may be performed on all strokes 55 cates the minimum coordinates (X, Y) of the stroke data, 

that were input before the changing of the predetermined That is, and indicate the diagonal points of a 

value. circumscribed rectangle of a stroke. P^, P2, • • . , and P„ 

As described above, the contents of the second dustering indicate a sequence of points of the coordinates which form 

rule 5 used for the second clustering process are different the stroke. The above^escribed coordinates coincide with 

from those of the first dustering rule 5 used for the first 60 coordinates on the screen of the display means 7 and 

clustering process. Also, the second clustering process dif- represented by the X-Y coordinate system with the upper 

fers from the first chistering process in that dustering left comer of the screen as the origin, 

between all of the stroke information stored in the stroke The stroke information of the clustered stroke data is 

storage means 2 is targeted. described in a sequence of data LV^ Ln, FT, ET, FP, EP, 

The dustering command execution means 6, as described 65 M^, M^, and a BD part, as shown in FIG. 2B. LV„ 

above, is a means for instructing the dustering means 4 to indicates the dustering level, also indicating the number of 

execute the second clustering process. When an instruction times that clustering has been performed. Ln indicates the 
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data length of this stroke information similarly to Lo of the 
stroke information of the stroke data. The earliest input start 
time from among aU the stroke input start times contained in 
this clustered stroke data is assigned to FT. The latest input 
end time &om among all the stroke input end times con- 
tained in this cliistered stroke data is assigned to ET. The 
start-point cxK>rdinate of the stroke having the earliest input 
start time is assigned to FP. The end-point coordinate of the 
stroke bavii^ the latest input end time is assigned to £P. 
indicates the maximum coordinates (X, Y) of all the strokes 
contained in this clustered stroke data. indicates the 
minimum coordinates (X, Y) of the ^roke data contained in 
this clustered stroke data. Inserted into the BD part is 
clustered stroke data having a clustering level lower than the 
chistcring level indicated by LV„. This makes it possible to 
realize a hierarchical clustered stroke data structure. 

An example of this hierarchical clustered stroke data 
structure will be described below with reference to FIG. 3. 
FIG. 3 shows an example of a hierarchical clustered stroke 
data structure displayed on the display means of the hand- 
writing information input apparatus of FIG. 1. 

When each stroke which forms, for example, a character 
"P' is input as handwriting information at an interval within 
a predetermined time which is a determination reference for 
grouping, a first chisiering process is performed on each 
stroke. In the first clustering process, since the difference in 
input time between the strokes which form the character "P" 
is below the predetermined time, it is determined that the 
two strokes which form the character "P* belong to the same 
group, and clustered stroke data such that each stroke which 
forms the character "P* is grouped is ^ored as stroke 
information in the stroke storage means 2. This clustered 
stroke data is formed of data in the format shown in FIG. 2B 
described above, and the LV„ is set to "1". Then, when each 
stroke which forms the character "E" is input at an interval 
within the predetermined time, clustered stroke data such 
that the two strokes which form the character "E** are 
grouped is stored as stroke information in the stroke storage 
means 2. Fmther, a stroke representing a third character "N** 
is input Since this writer inputs "N" in one stroke, \bc stroke 
data representing "N" is stored in the stroke storage means 
2. 

When the strokes which form each character of these "P", 
"E" and "N" arc being input, as shown in FIG. 3, the strokes 
which fonn each character of the "P*, "E" and "N" are 
displayed each in cluster units on the display screen of the 
display means 7. Specifically, each character, namely, the 
cluster unit, is di^layed together with rectangles (diown by 
the dotted lines) 30, 31 and 32 which surround it, and the 
rectangles 30, 31 and 32 shown by these dotted lines make 
it possible to know the range in which clustering has been 
performed. 

FoUowing the inputting of each character "P^, "E" and 
"N", when each stroke which forms an c^ject representing 
a house is input in such a way that the difference (distance) 
between the start point and the end point between the strokes 
falls bcbw a predetermined value, the first clustering pro- 
cess is performed even if the difference in input time 
between the strokes is not below the predetermined time. In 
the first clustering process, also based on the fact that the 
difference (distance) between the start point and the end 
point between the strokes is below the predetermined value, 
it is determined that these strokes belong to the same group, 
and clustered stroke data such that each stroke which fomss 
this object is grouped is stored as stroke information in the 
stroke storage means 2. Similarly to eadi character "P*, "E" 
and "hT, the object, namely, the cluster unit is displayed 
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surrounded by the rectangle (shown by the dotted line) 34. 
This rectangle is a rectangle expressed by Ny* and M„P 
which arc stored in the stroke storage means 2. 
Together with the stroke or the clustered stroke, a clus- 

5 tering execution icon 35, a clustering display icon 36, a 
move icon 37, a delete icon 38, a grouping icon 39, and a 
grouping release icon 40 are displayed on the display screen 
of the display means 7. 

The clustering execution icon 35 is an icon for instructing 

10 the execution of the above-described second clustering 
process. When this clustering execution icon 35 is pointed 
to, the second clustering process is performed on all of the 
stroke information stored in the stroke storage means 2. For 
example, when the chi^ering execution icon 35 is clicked on 

J 5 and the second clustering process is performed on all the 
stroke information shown in FIG. 3, the difference in posi- 
tional information between each clustered stroke data of the 
characters "P\ "E" and "N" and the stroke data, namely, the 
difference between each clustered stroke and the drcum- 

2Q scribed rectangle (the rectangles 30, 31 and 32 in FIG. 3) is 
found to be equal to or less than a predetermined value, it is 
determined that each clustered stroke and the stroke belong 
to the same group, and stroke information including each 
clustered stroke of "P', "E" and "N" and the stroke is 

25 generated. That is, this stroke information indicates a hier- 
archical data structure including each clustered stroke of 
«P\ "E" and "N" and the stroke, and a rectangle 33 shown 
by the solid line which surroimds "P*, "E" and "N" is 
displayed as the clustering execution results on the display 

30 means 7. 

The clustering display icon 36 is an icon for changing the 
display format of the clustered stroke data. Each time this 
icon is pointed to, the display format of the clustered stroke 
data is changed. Specifically, in a state in which the clustered 

35 stroke data is displayed surrounded by a rectangle as 
described above, when the clustering display icon 36 is 
pointed to, the displayed rectangle is deleted, and only the 
clustered stroke data is di^layed. 

The move icon 37, the delete icon 38, the grouping icon 

40 39, and the grouping release icon 40 are icons used for 
editing operations as described above. The pointing to of the 
move icon 37 sets the move mode, making possible an 
editing operation for pcrfisrming a movement in cluster 
units. The delete icon 38 is an icon for performing deletion 

45 in cluster units. The grouping icon 39 is an icon for per- 
forming grouping in the same way as in a conventional 
drawing-type application. As a result of the pointing to of 
this icon, a grouping mode is set. In this grouping mode, 
clustered stroke data or stroke data, which forms cluster 

50 units, is selected by the operator. When the grouping icon 39 
is pointed to after this selection is completed, the selected 
clustered stroke dau or ^roke data is grouped as one cluster. 
When a particular editing operation is performed on this 
cluster, editing of the same contents is performed on all of 

55 the chistered stroke data or the stroke data contained in this 
cluster. The grouping release icon 40 is an icon for separat- 
ing the cluster which is grouped in accordance with an 
instruction from the grouping icon 39 to the original data. By 
specifying tbe grouped cluster after this icon is pointed to, 

60 the BD part of the data having tbe highest-order clustering 
level from among the data indicating the cluster is made to 
remain and the other parts are deleted. 

Next, the procedure of the first clusterii^ process when a 
stroke is input will be described with reference to FIG. 4. 

65 FIG. 4 is a flowchart iUustrating the procedure of the first 
clustering process in the handwriting information input 
apparatus of FIG. 1. 
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Wbea stroke input using a pen £rom the stroke input 
nfcans 1 is started, as shown in FIG. 4, in the initial step 
S401, whether or not stroke input is finished is monitored, 
when it is determined that the stroke input is finished, the 
process proceeds to step S402 where clustering information 5 

acquired on the basis of the input stroke and stored in a 
b^cr BtifA. Clustering information to be stored in the 
buffer BufA is each of the data from LVq to EP shown in 
FIG. 2A. 

In the subsequent step S403, a stroke information counter 
set is initialized to "1". This stroke information counter set 
makes it possible to sequentially access the stroke informa- 
tion stored in the stroke storage means 2. 

Next, the process proceeds to step S404 where a check is 
Umade to determine whether or not stroke information cor- 
responding to the count value set of the stroke information 
counter set has been stored in the stroke storage means 2. 
When stroke information corresponding to the count value 
set is not present, the process proceeds to step S410 where 
the stroke information indicating the input stroke is stored at 
a position corresponding to the count value set of the stroke 
storage means 2. The stroke information stored herein is data 
'of the format shown in FIG. 2A. After the stroke information 
indicating this input stroke is stored, this process is termi- 
nated. 

Iw When stroke information corresponding to the count 
J value set is present, the process proceeds to step S405 where 
N stroke information (stroke information (set)) corresponding 
I to this count value set is read from the stroke storage means 
y 2. In the subsequent step S406, this stroke information 
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which has been read is stored in the buffer BufB. 

Next, the process proceeds to step S407 where the pos- 
sibility of grouping the input stroke and the read stroke 
information is determined by comparing the information 35 
which becomes the clustering information for the buffer 
BufA with the clustering information for the buffer BuCB in 
accordance with rule 1, which is a time comparison rule, of 
the first clustering rule 5 used in the first clustering process. 
Specifically, the difference between FT of the buffer BufA 40 
and ET of the buffer BufB is computed, thus determining 
whether or not the condition in which this difference, that is, 
the difference in input times, is equal to or less than the input 
^time difference 0.5 seconds defined by the rule 1 is satisfied. 
AVhen the condition of the input time difference defined by ^45 
this rule 1 is satisfied, it is determined that the input stroke 
and the read stroke information can be grouped, that is, 
clustering is possible. When the condition of the input time 
difference is not satisfied, it is determined that clustering is 
not possible. 50 

When it is determined that clustering based on the con- 
dition of the input time difference defined by rule 1 is not 
possible, tbe process proceeds to step S408 where the 
possibility of grouping the input stroke and the read stroke 
information is determined by comparing the information 55 
which becomes the dustoing information for the buffer 
BufA with the clustering information for the buffer BufB ixk > 
accordance with rule 2, which is a position comparison rule, 
of the first clustering rule 5 used in the first clustering 
process. Specifically, the difference between FP of the buffer 60 
BufB and FPof the buffer BufA or the difference between EP 
of the buffer BufB and EP of tbe buffer BufA is computed, 
and a check is made to determine whether or not the 
condition in which this difference, that is, the difference io 
input positions, is equal to or less than tbe input position 65 
diff^nce 2 mm defined by the rule 2 is satisfied. When the 
condition of the input position difference defined by this rule 



2 is satisfied, it is determined that the input stroke and the 
read stroke information can be grouped, that is, chistering is 
possible. When the condition of the input position difference 
is not satisfied, it is determined that clustering is not pos- 
si*blc. 

When it is determined that the cindering based on the 
condition of the input position difference defined in rule 2 is 
not possible, the process proceeds to step S409 where the 
count value set of the stroke information counter set is 
incremented by 1, and the process from step S404 is 
repeated. 

When it is determined in step S407 that clustering based 
on the condition of the input time difference defined by rule 
1 is possible, or when it is determined that clustering based 
on the condition of the input position difference defined by 
rule 2 is possi'ble, the process proceeds to step S411 where 
clustering of the input stroke and the read stroke information 
is performed. 

Specifically, a process corresponding to the value of the 
clustering level LV„ of the stroke information read from the 
stroke storage means 2 is performed. When the value of the 
LV„ of the read stroke information is 1 or more, information 
of the buffer BufA is written into the BD part of the read 
stroke information and the read stroke information is 
updated. This read stroke information after being updated is 
stored in the buffer BufA, and the information stored in the 
buffer BufA becomes information sudi that the input stroke 
and the read stroke information are grouped, and the data 
length of this information is expressed by an equation (1) 
below: 

Ln oiBi^^n ^fore being clustered) oZ BufA-^Ln (before being 
clustered) of BufB (1) 

When the value of LV„ of the read stroke information is 
0 («LVo), LV„, Ln, FT, FP, M^, and of the buffer BufA 
can be rewritten in accordance with the following equations 
(2) to (7): 



(2) 



Ln of Bt4B=Ln (before being clustered) of Bi^+Ln (before being 
clustered) of BuJB (3) 

FToiBi^'fTotBufB (4) 

FP ol Bi^~FP ol BuJB (5) 

of Bt4A''MAX (Af^ of BujA, of BufB) (6) 

of BufiK'MW (MJ' of Bt^A, MJ' of BufB) (7) 

In this BufA, following M„P, a BD part is added in which 
the read stroke information and the input stroke information 
are written. The information stored in this BufA becomes 
information such that the input stroke and tbe read stroke 
information are grouped. 

When the information after being clustered is stored in the 
BufA as described above, the process proceeds to step S412 
where the read stroke information, namely, the stroke infor- 
mation (set) is deleted finom the stroke borage means 2, and 
in tbe subsequent step S413, the information of the buffer 
BufA is stored as stroke information at tbe storage position 
of this read stroke information. After this stroke information 
is stored, this process is terminated. 

As a result of the above, in this embodiment, the possi- 
bility of clustering this input stroke and tbe previously input 
stroke is determined in accordance with chistering rule 5 
each time a stroke is input &om the stroke input means 1. 
When it is determined that clustering is possible, stroke 
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As described above, by pointing the clustering execution 
icon 35, it is possible to read consecutively the object stroke 
information and the stroke information for a clustering 
candidate thereof from the stroke storage means 2 and to 
group automatically cad} stroke information close to each 
other, making it possible to provide the operator with a 
simple and cfiScicnt operation environment 

When the results of grouping obtained by the first or 
second clustering process are contrary to the intention of the 
user, it is possible to release the grouping in accordance with 
the pointing to of the grouping release icon 40, making 
possible an editing operation in accordance with the inten- 
tion of the user. 

Although in this embodiment two buffers, BufA and 
BufB, are provided as an information storage area and a 
work area, the information storage area and the work area 
are not limited to these buffers BufA and BufB and may be 
storage means in which both a stroke information storage 
area and a work area are allocated. 

Second Embodiment 

Next, a second embodiment of the present invention will 
be described with reference to FIG. 5. FIG. 5 shows the 
format of stroke information stored in stroke storage means 
in the second embodiment of a handwriting information 
input apparatus according to the present invention. 

The construction of this embodiment is the same as the 
construction of the above-described first embodiment and 
therefore, a description thereof has been omitted. The sec- 
ond embodiment is different firom the first embodiment in 
that a second clustering process is performed by applying a 
clustering rule in ^ich conditions of display attributes are 
added, and this difference will be described below. 
33 In this embodiment, when the execution of a clustering 
process is instructed fi-om the clustering command execution 
means, a second clustering process is performed. The clus- 
tering rule used in this second clustering process defines that 
when the difference (distance) in position information 
^ between the strokes (between the stroke information stored 
in the stroke storage means), i.e., the difference in distance 
between the circumscribed rectangles of each stroke, is 
equal to or less than a predetermined value (3 mm) and the 
display attributes are the same, then each stroke belongs to 



information is generated such that this input stroke and the 
previously input stroke are grouped; therefore it is possible 
to group a plurality of input strokes efficiently without 
spending much time and effort on an operation. 

In this embodiment, two rules, of which one is based on 
the condition of the input time difference and the other on 
the input position difference, arc each applied individually as 
clustering rule 5 used in the first clustering process per- 
formed when a stroke is input. It is not necessary, however, 
to limit to these rules^ and further, it is also possible to 
increase the number of rules to be applied and to determine 
the possibility of the execution of clustering so as to perform 
clustering. 

Further, the contents of conditions of the rules to be 
applied are not limited to the above -described conditions 
and may be conditions obtained from the stroke information. 
Needless to say, it is possible to set various conditions. 

Next, a description will be given of a second clustering 
process performed in accordance with an instruction from 
the clustering execution icon 35. In the second clustering 
process, as described above, a second clustering rule 5 is 
applied such that when the difference (distance) in position 
information between strokes (between stroke information 
stored in the stroke storage means 2), that is, the difference 
of the distance between the circumscribed rectangles of each 
stroke, is equal to or less than a predctcnnined value (e.g., 
3 mm), each stroke belongs to the same group. The second 
clustering process is different firom the first clustering pro- 
cess in that clustering between all the stroke information 
stored in the stroke storage means 2 is the object 

Based on such a difference with the first clustering 
process, in this process, initially, waiting for an input of 
pointing to the clustering execution icon 35 is done. When 
there is an input of pointing to the clustering execution icon 
35, the second clustering process is invoked. Then, the 
object stroke information is read from the stroke storage 
means 2, stored in the buffer BufA, and then stroke infor- 
mation for a candidate of the stroke information of the buffer 
BufA is read and stored in the buffer BufB. 

Next, a check is made to determine whether or not the 
condition is satisfied in which the difference between of 
BufA and of BufB or the difference (difference in 
distance between the circumscribed rectangles) between 
M„P of BufA and M^P of BufB is equal to or less than a 

predetermined value, that is, 3 mm. When this condition of 45 same group. Here, the display attributes refer to the 
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the difference in distance between the circumscribed rect- 
angles is satisfied, it is determined that the stroke informa- 
tion of the buffer BufA and the stroke information of the 
buffer BufB can be grouped, that is, clustering is possible. 
When this condition of the distance between the circum- 
scribed rectangles is not satisfied, it is determined that 
clustering is not possible. 

When it is determined that the clustering based on this 
condition is not possible, stroke information which is the 
next candidate is read, and the above-described process is 
repeated. 

When it is determined that the clustering based on this 
condition is possible^ chi^ering of the stroke information of 
the buffer BufA and the stroke information of the buffer 
BufB is performed. Although the method of updating the 
stroke information on the basis of this clustering is the same 
as the updating method in the first clustering process, this 
method is different in that as a result of the storing of the 
updated stroke information in the stroke storage means 2, the 
stroke information of the buffer BufA and the stroke infor- 
mation of the buffer BufB are deleted from the stroke storage 
means 2. 
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thickness and color of a line that forms a stroke, and the like. 
In this embodiment, the thickness and the color of the line 
that forms a stroke are used as the display attributes. 

As a result of adopting a rule in which the display 
attributes of the thickness and color of tlus line are added, 
the thirtrnRRR and color of the line are added to the stroke 
information. To be specific, as shown in FIG. 5, the stroke 
information of the clustered stroke data is described in a 
format formed of a sequence of data LV^ Ln, FT, ET, FP, EP, 
MJ>, MJ», U. 51, 52, and a BD part 51 is data 
indicating the thickness of the line, and 52 is data 
indicating the color of the line. Although the stroke infor- 
mation of the stroke data (which corresponds to the stroke 
information shown in FIG. 2A) is not shown in the figure, 
the stroke information is such that the above-described 
and are added to the stroke information shown in FIG. 
2A. 

In the second clustering process, through the application 
of the above-described clustering rule, it is determined that 
each stroke can be grouped when the difference in distance 
between the strokes is equal to or less than a predetermined 
value (3 nmi) and the display attributes are the same, and 
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each stroke is grouped into tbe same group. Siace the 
condition in which tbe di^lay attributes are the same is 
added as a condition for chistcring as described above, it 
becomes possible to perform more appropriate groupii^. 
For example, in tbe case where an editing operation for 
changing tbe thickness and the color of the line of tbe input 
stroke is possible, when it is not desired to group one and tbe 
other of the strokes which are input close to each other into 
one, the thickness and the color of tbe line of either one of 
the strokes are changed before the second clustering process 
is performed. This prevents one and tbe otber of the strokes 
which are input close to each otber from being grouped, 
making it possible to obtain the grouping results appropriate 
for tbe intention of tbe operator. 

Further, when performing grouping using a grouping 
icon, an editing operation for changing the display attributes 
and of each stroke, contained in the grouped cluster, 
is performed. Through this editing operation, the display 
attributes of each stroke contained in the grouped cluster are 
changed so as to become tbe same attributes, and tbe 
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and the stored stroke information, when said determin- 
ing step determines that tbe new input ^roke informa- 
tion satisfies tbe clustering rule. 

2. Ad information input method according to claim 1, 
wherein the input stroke information contains a sequence of 
coordinate points which are input in succession. 

3. An information input method according to claim 1, 
wherein the input stroke information contains a sequence of 
coordinate points which are input in succession and time 
information at which the sequence of coordinate points are 
input. 

4. Ad information input method according to claim 1, 
wherein the clustering mie contains a threshold value used 
for a determination criterion for determining whether or not 
a plurality of stroke information should be grouped. 

5. An information input method according to claim 4, 
wherein said threshold value is distance information. 

6. An information input method according to claim 4, 
wherein said threshold value is time information. 

7. An information input method according to claim 4, 



clustered Stoke witWn each sfroke is set in such a way that M ^^^^^.^ ^^^^^^^^ ^^^^^ ^ ^ ^^^^^ ^^^^^ 

only the display attributes of the clustered stroke havmg the 
highest-order clustering level arc changed. 

When the clu^er grouped by the grouping release icon is 
decomposed to the original data, similarly to the first 
embodiment, the BD part of the data having the highest- 
order clusterii^ level of tbe data indicating the specified 
cluster is made to remain and the other parts are deleted. 
However, in the display of each datum after the 
decomposition, the di^lay attribute are held, and each 
datum is displayed on the basis of the held display attributes. 

Although in this embodiment the thickness and the color 
of the Une are used as the display attributes which are used 
as the clu;^ering conditions, in place of these, display 
attributes with reference to the stroke input environment 
(e.g., an input environment on a drawing-type application), 
such as a line type, for example, a solid line or a dotted line, 
or the shape of the pen point, may be used. Further, items 
with a larger number of display attributes may be added or 
set as the chistering conditions. 

Furthermore, needless to say, by setting so that the display 
attributes for each stroke are stored in other storage areas in 
such a manner as to correspond to the stroke, the format of 
tbe stroke information can be made to be the same format as 
that of the first embodiment. 

Many different embodiments of the present invention may 
be constructed without departing from the spirit and scope of 
the present invention. It should be understood that the 
present invention is not limited to the specific embodiments 
descnl>ed in this specification. To the contrary, the present 
invention is intended to cover various modifications and 
equivalent arrangements included within the spirit and scope 
of the invention as hereafter claimed. The scope of the 
foUowing claims is to be accorded the broadest interpreta- 
tion so as to encompass all such modifications, equivalent 
structures and fiinctions. 

What is claimed is* 

1. An information input method, comprising the steps of: 
inputting stroke information which represents one stroke 

handwritten by a user, 
sloring the input stroke information; 
determining whether or not a clustering rule is satisfied 
each time [kw stroke information representing one 
stroke is input, by comparing the new input stroke 
information with the stored stroke information; and 
Coring clustering infiarmation generated by clustering the 
new input stroke information representing one stroke 



8. An information input method according to claim 1, 
wherein the stored stroke information comprises both single 
stroke information and clustered stroke information such 
that a plurality of strokes arc grouped. 

9. An information input method according to claim 8, 
wherein a group of the plurality of clustered strokes are 
output in such a manner as to be identified. 

10. An information input method according to claim 8, 
further comprising a step of displaying the stored stroke 
information, wherein a frame is displayed surrounding the 
plurality of clustered strokes in addition to tbe stroke infor- 
mation. 

11. An information input method according to claim 1, 
wherein the input stroke information is handwritten infor- 
mation. 

12. An information input method according to claim 1, 
wherein the clustering information storing step stores new 
clustering information generated on the basis of the new 
input stroke information, when said determining step deter- 
mines that the new input stroke information does not satisfy 
the clustering rule. 

13. An information input apparatus, comprising: 
input means for inputting stroke information which rep- 
resents one stroke handwritten by a user; 

storage means for storing stroke infonnation input from 

said input means; 
detennination means for determining whether or not a 
clustering rule is satisfied each time new stroke infor- 
mation representing one stroke is input, by comparing 
the new input stroke information with the stored stroke 
information; and 
clustering means for performing control so that, when 
new input stroke infonnation is determined to satisfy 
the clustering rule by said determination means, clus- 
tering infonnation is generated by clustering the new 
input stroke information representing one stroke and 
the stored ^roke information, and tbe clustering infor- 
mation is ^red in said storage means. 

14. An information input apparatus according to claim 13, 
wherein the input stroke information contains a sequence of 
coordinate points which are input in succession. 

15. An information input apparatus according to claim 13, 
wherein the input stroke information contains a sequence of 

65 coordinate points which are input in succession aad time 
information at which the sequence of coordinate points are 
input. 
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16. An information input apparatus according to claim 13, 
wherein the clustering nile contains a threshold value used 
for a determination criterion for determining whether or iKit 
a plurality of stroke information should be grouped. 

17. An information input apparatus according to claim 16, 
wherein the threshold value is distance information. 

18. An information input apparatus according to claim 16, 
wherein the threshold value is time information. 

19. An information input apparatus according to claim 16, 
wherein the threshold value Is a variable value. 10 

20. An information input apparatus according to claim 13, 
wherein said storage means stores both single stroke infor- 
mation and clustered stroke information such that a plurality 
of strokes are grouped as stroke information. 

21. An information input apparatus according to claim 20, 15 
wherein there is provided output means for outputting a 
group of said plurality of strokes clustered by said clustering 
means in such a manner as to be identified. 

22. An information input apparatus according to claim 20, 
further comprising display means for displaying the stored 20 
stroke information and displaying a &ame which surroimds 



said plurality of strokes clustered by said clustering means 
in addition to the stroke information. 

23. An information input apparatus according to claim 13, 
wherein the stroke information is handwritten information. 

24. A computer-readable storage medium containing pro- 
gram codes to control a computer to perform the following 
steps: 

inputting stroke information which represents one stroke 
handwritten by a user, 

storing the input stroke information; 

determining whether or not a clustering rule is satisfied 
each time new input stroke information representing 
one stroke is input, by comparing the new input stroke 
information with the stored stroke information; and 

storing clustering information generated by clustering the 
new input stroke information representing one stroke 
and the stored stroke information, when it is deter- 
mined that the new input stroke information satisfies 
the clustering rule. 
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